Data transmission method for embedded data, data transmitting and reproducing apparatuses and information recording medium therefor

ABSTRACT

In a data transmission method for information data containing additional information data therewith, comprising, at a transmitter side, following steps: 
     adding error correction codes for correcting error to said additional information data; 
     embedding said additional information data added with said error correction codes into the information data by plural times, repetitively; and 
     transmitting the information data embedded with the repetitive additional information data therein, and comprising, at a receiver side, following steps: 
     receiving the transmitted information data embedded with the repetitive additional information data therein; 
     detecting the repetitive additional information data embedded from said transmitted information data received; 
     determining said additional information data on a basis of a majority rule when receiving said information data; and 
     correcting error with using the error correction codes received and determined when said additional information data contains error(s) therein.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is related to application Ser. No. 09/144,467,filed Sep. 1, 1998 entitled “WATERMARK EMBEDDING METHOD AND SYSTEM” byI. Echizen et al now pending; application Ser. No. 09/144,989, filedSep. 1, 1998 entitled “METHOD AND SYSTEM FOR EMBEDDING INFORMATION INTOCONTENTS” by H. Yoshiura et al now pending; and application Ser. No.09/148,325, filed Sep. 4, 1998 entitled “RECORDING/REPRODUCING METHODAND APPARATUS PROCESSING APPARATUS AND RECORDING MEDIUM FOR VIDEO SIGNALHAVING COPY CONTROL INFORMATION” by H. Kimura et al now pending.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a data transmission method fortransmitting and receiving data, such as video and/or audio data inwhich additional information data (i.e., data hiding or water mark,etc.) are embedded or concealed, and apparatuses for transmitting andreproducing such the video and/or audio data, and in particular, relatesto data transmitting and reproducing apparatuses for embedding anddetecting the additional information data which are embedded orconcealed into the data being transmitted, as well as an informationrecording medium therefor.

2. Description of Prior Art

Up to now, data hiding has been studied or researched as a technologyfor embedding or concealing an identification information and/or anannotation into original contents in a form of, such as text data and/oraudio/video data. In recent years, the data hiding technology begins tobe applied as a technology for protecting a copy right from illegaloperations, such as copying of the original data, by embedding such theidentification information into them. Such the technology is describedin “Data Hiding Technology for Supporting Electronic Water Mark(Upper)”, pages 149 through 162, NIKKEI ELECTRONICS 1997.2.24 (no.683),by Nikkei Business Publications, Inc.

The data being embedded into the original data, however, aredeteriorated through various operations including, such as a filtering,a data compression and so on, thereby, they sometimes happen to beremoved from them, for instance, in particular, after encoding/decoding(or converting/inverting) operation thereof. Therefore, such the hiddendata are inserted or embedded in the original data or the likerepetitively, so as not to be deleted therefrom easily.

However, in the prior art mentioned in the above, there is nodescription or teaching about a concrete and/or practical way ofreproducing the additional information data which are embedded into theoriginal data repetitively, with a low error rate.

Since the video or picture data is large in an amount thereof,therefore, normally it is transferred after being compressed. Thetransferred data is then de-compressed to be restored into the originaldata, however, it is impossible to restore them back to the originalones perfectly or completely, due to the processes of such thecompression/de-compression. Further, when transmitting the data, errorsmay occur in the data depending on the route of the data transmission.For restoring such the erred data, it is ordinary to add an errorcorrection code onto it previously, and then so-called correction of theerred data can be performed therewith. However, in the restoration ofthe data with such the error correction code, though it is possible todetect the error(s) occurring in the data, it is sometimes impossible torestore or correct them if the reliability of the data itself cannot beensured at a level higher than a certain level. Therefore, it isnecessary that an error rate of the data being transmitted must bereduced as low as the error correction is possible to be applied in thelevel or degree thereof.

SUMMARY OF THE INVENTION

An object of the present invention is, therefore, for dissolving theproblems in the above-mentioned conventional art, to provide atransmission method of such the data into which additional informationdata, including identification information data, control data and so on(hereinafter, comprehensively described by “identification informationdata”), and a data transmitting apparatus and a data reproducingapparatus, as well as an information recording medium therefor.

For achieving the above-mentioned object, in accordance with the presentinvention, first of all, there is provided a data transmission methodfor information data containing additional information data therewith,comprising, at a transmitter side, following steps:

a fist step for adding error correction codes for correcting error tosaid additional information data;

a second step for embedding said additional information data added withsaid error correction codes into the information data by plural times,repetitively; and

a third step for transmitting the information data embedded with therepetitive additional information data therein.

Also, for achieving the above-mentioned object, in accordance with thepresent invention, there is provided a data transmission method for theinformation data transmitted through the method as defined in the above,comprising, at a receiver side, following steps:

a fourth step for receiving the transmitted information data embeddedwith the repetitive additional information data therein;

a fifth step for detecting the repetitive additional information dataembedded from said transmitted information data received in the fourthstep;

a sixth step for determining said additional information data on a basisof a majority rule when receiving said information data; and

a seventh step for correcting error with using the error correctioncodes received and determined when said additional information datacontains error(s) therein.

Further, for achieving the above-mentioned object, in accordance withthe present invention, there is provided a data transmission method forinformation data containing additional information data therewith,comprising, at a transmitter side, following steps:

a fist step for encoding said additional information data in accordancewith a predetermined conversion table;

a second step for embedding said additional information data encoded inthe above step into the information data by plural times, repetitively;and

a third step for transmitting the information data embedded with therepetitive additional encoded data therein.

Also, for achieving the above-mentioned object, in accordance with thepresent invention, there is provided a data transmission method for theinformation data transmitted through the method as defined in the above,comprising, at a receiver side, following steps:

a fourth step for receiving the transmitted information data embeddedwith the repetitive additional information data encoded;

a fifth step for detecting the repetitive additional information dataencoded, which are embedded within the information data received;

a sixth step for determining said encoded additional information data ona basis of a majority rule of the repetitive encoded additionalinformation data detected; and

a seventh step for decoding the encoded data into the additionalinformation data.

Further, for achieving the above-mentioned object, in accordance withthe present invention, there is provided a data transmission method fortransmitting information data containing additional information datatherewith, comprising following steps at a transmitter side:

a step for preparing data frames of said information data into which theadditional information data are to be embedded;

a step for altering at least part of the data frame in accordance withpredetermined patterns corresponding to the additional information datato be embedded, for the plural continuous frames, repetitively; and

a step for transmitting the information data embedded with therepetitive additional information data therein.

And, also, for achieving the above-mentioned object, in accordance withthe present invention, there is provided a data transmission method forthe information data transmitted through the method as defined in theabove, comprising, at a receiver side, following steps:

a step for receiving the transmitted information data embedded with therepetitive additional information data therein;

a step for detecting the repetitive additional information data embeddedfrom said transmitted information data; and

a step for determining said additional information data on a basis ofcontinuity of the repetitive additional information data detected for apredetermined times.

And also, for achieving the above-mentioned object, in accordance withthe present invention, there is further provided a data transmittingapparatus for transmitting information data containing additionalinformation data therewith, comprising:

a first means for adding error correction codes for correcting error tosaid additional information data;

a second means for embedding the additional information data added withthe error correction codes by said first means into the information databy plural times, repetitively; and

a third means for transmitting the information data embedded with therepetitive additional information data therein.

Also, for achieving the above-mentioned object, in accordance with thepresent invention, there is provided a data reproducing apparatus forreproducing the transmitted information data transmitted by the datatransmitting apparatus defined in the above, comprising:

a first means for receiving the transmitted information data embeddedwith the repetitive additional information data therein;

a second means for detecting the additional information data embeddedfrom the transmitted information data received by said first means;

a third means for determining said additional information data on abasis of a majority rule when receiving said information data; and

a fourth means for correcting error with using the error correctioncodes received and determined when said additional information datacontains error(s) therein.

And also, for achieving the above-mentioned object, in accordance withthe present invention, there is provided a data transmission apparatusfor transmitting information data containing additional information datatherewith, comprising:

a fist means for encoding said additional information data in accordancewith a predetermined conversion table;

a second means for embedding said additional information data encoded inthe first means into the information data by plural times, repetitively;and

a third means for transmitting the information data embedded with therepetitive additional encoded data therein.

Also, in accordance with the present invention, there is provided a datareproducing apparatus for reproducing the transmitted information datatransmitted by the data transmitting apparatus defined in the above,comprising:

a first means for receiving the transmitted information data embeddedwith the repetitive additional information data encoded;

a second means for detecting the repetitive additional information dataencoded which are embedded within the information data received;

a third means for determining said encoded additional information dataon a basis of a majority rule of the repetitive encoded additionalinformation data detected; and

a fourth means for decoding the encoded data into the additionalinformation data.

And further, according to the present invention, there is provided adata transmission apparatus for transmitting information data containingadditional information data therewith, comprising:

a first means for preparing data frames of said information data intowhich the additional information data are embedded;

a second means for altering at least part of the data frame inaccordance with predetermined patterns corresponding to additionalinformation data to be embedded, for the plural continuous frames,repetitively; and

a third means for transmitting the information data embedded with therepetitive additional information data therein.

Further, according to the present invention, there is provided a datareproducing apparatus for reproducing the transmitted information datatransmitted by the data transmitting apparatus defined in the above,comprising:

a first means for receiving the transmitted information data embeddedwith the repetitive additional information data therein;

a second means for detecting the repetitive additional information dataembedded from said transmitted information data; and

a third means for determining said additional information data on abasis of continuity of the repetitive additional data detected for apredetermined times.

Moreover, also for achieving the above mentioned object, in accordancewith the present invention, there is also provided an informationrecording medium for recording data therein, comprising:

information data being reproducible;

additional information data which are embedded into said informationdata repetitively; and

error correction codes which are added to said additional informationdata and also embedded into said information data repetitively.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 shows an embodiment of a flow of processes of coding/decoding forthe data transmission, in accordance with the present invention;

FIG. 2 shows in more details of the processes of the transmission of theadditional information data as shown in FIG. 1;

FIG. 3 shows an embodiment of a process for embedding the additionalinformation into the video data;

FIG. 4 shows an example of the points or positions, at which theadditional information data are embedded, within one piece of thepicture as a whole;

FIG. 5 an embodiment of a signal processing apparatus of performing theprocess of coding/decoding, for the data transmission according to thepresent invention;

FIG. 6 shows an another variation of the flow of processes ofcoding/decoding for the data transfer, according to the presentinvention;

FIG. 7 shows further other variation of the flow of processes ofcoding/decoding for the data transfer, according to the presentinvention;

FIG. 8 shows an another embodiment of the flow of processes ofcoding/decoding for the data transfer, according to the presentinvention;

FIG. 9 shows an example of a method of deciding the identification datawhen receiving them which are embedded in accordance with the mannershown in FIG. 8; and

FIG. 10 shows an example of changes in the condition in the decisions onthe identification information data at that time.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Hereinafter, various embodiments and variations of a data transmissionmethod and an apparatus for transmitting and reproducing original data,such as the video and/or audio data, according to the present invention,will be fully explained by referring to the attached drawings.

FIG. 1 shows an embodiment of a flow of processes of coding/decoding forthe data transmission, in accordance with the present invention.

In FIG. 1, there are shown an identification information bits oridentification bits, i.e., of n bits (b0, b1, b2, . . . bn−1), and errorcorrection codes, being added for executing the error correction uponthe identification information bits when the error(s) occurs/occurtherein, i.e., of m bits (bn, bn+1, bn+2 . . . bn+m−1), including suchthe data hiding and/or water mark or the like therein, thereby formingan additional information data, i.e., of n+m bits (b0, b1, b2 . . . bn,bn+1, . . . bn+m−1) to be embedded into an original data, including suchas text data or audio/video data. In order to reduce influences upon theadditional data due to a transmission system, the same data are embeddedrepetitively, i.e., by a plurality of times (for instance, P times) intothe original data to be transmitted.

Here, as one way of repetition for each of the information bits of theadditional information data is, each bit is embedded and transferred byP times, respectively, as is shown below:

b0, b0, b0 . . . b0 P times b1, b1, b1 . . . b1 P times . . . . . . . .. . . . . . . . . . bn+m−1, bn+m−1, bn+m−1 . . . bn+m−1 P times

or, alternatively, by forming an unit of data of m+n bits with theadditional data to be embedded and transferred, as is shown below:

(b0, b1, b2 . . . bn+m−1), (b0, b1, b2 . . . bn+m−1), . . . P times

However, other ways than the mentioned in the above can also be appliedthereto. The details in a method for embedding of the additionalinformation data will be given later.

Heretofore is the explanation on processes or operations at a datatransmission side. Namely, the additional information data, includingsuch the identification bits and the error correction code, are embeddedor concealed into the transmission data to be transferred, repetitively,and is transferred through the transmission system to a receiver side ofthe data. At the receiver side, a decision is made on the basis ofso-called a majority rule with respect to the additional informationdata which are transferred repetitively. For instance, when the data bitb0 is transferred by P times, the value of the bit is decided to be thatof the majority among b0s of number P, for instance, b0=1 or 0. In thesame manner, by collecting data of the P pieces for each of the bits(b0, b1, b2 . . . bn+m−1) and determining the value for each bit by themajority rule, the additional information data (of n+m bits) can beobtained. Thereafter, error(s) occurring among the identificationinformation bits is/are detected and corrected by means of the errorcorrection codes of m bits, thereby obtaining the identificationinformation bits of n bits correctly.

By transferring the additional information data with use of such themethod, it is possible to practice the error correction by means of theerror correction code while reducing the error rate in the additionalinformation data which are embedded and transferred.

FIG. 2 shows in more details of the processes of the transmission of theadditional information data as shown in FIG. 1. In this example showshere, the additional information data are embedded or concealed withinthe video data so as to be transferred. However, the original data intowhich the additional information data are to be embedded should not berestricted only to such the specific one, such as the video and/or audiodata or the like.

In the same figure, the additional information data are prepared for therepetitive transmissions of P times with adding the error correctioncodes to the identification information data, and those are embedded orconcealed into the video data. Here, however, points or positions wherethe each additional information data is embedded are determined inadvance, or the information of those points are also possible to bealready transferred to the receiver side by an another means in advance.The data of image located corresponding to those points where the eachadditional information data are embedded are converted or altered ineach value of the bits thereof, according to the values of theinformation, though details of the conversion of the bits will be givenlater.

Those embedded additional information data are compressed in the mannerwhich is same to that of the data of the other data, i.e., the data ofpixel blocks of the video data, and are encoded if necessary. The datawhich are processed in this manner are transferred by recording themonto a package medium of such as a CD or a DVD, or are transferreddirectly through radio waves, in such a case of broadcasting.

Next, the package medium is received and/or reproduced (playback) bymeans of a reproducing apparatus as a means for receiving, or the radiowave is received by a receiver in the case of the broadcasting. And,then the data are processed with decoding process in accordance with theencoding method mentioned above. After that, the data which arecompressed are extracted or extended. Here, the embedded additionalinformation data are detected from the pixel data of the pixel blocks ofthe video data by means of a detector for detecting the additionalinformation data which are embedded into the video data. The embeddedadditional information data which can be obtained in this manner aredetected from the positions of the number P, i.e., the P pixel blockswithin the video data, for each of the bits of the additionalinformation data, and the decision by the majority rule is applied withrespect to the each bit. Namely, this process is applied to the n+m bitsso as to obtain the additional information data, and the correction ofthe errors is performed by means of the correction codes also containedin the additional information data, thereby, obtaining the correctvalues of the information bits of the additional information datawithout errors.

With using such the method, it is possible to transfer the additionalinformation bits embedded or concealed into the original data, as wellas to obtain the information bits thereof with a low error rate,thereby, it is possible to transfer such the addition information with ahigh reliability.

FIG. 3 shows an embodiment of a process for embedding the additionalinformation into the video data. A piece of a picture (i.e., the videodata) can be replaced with a set of data, and in order to perform theembedding process to the data, first of all, they are divided into theplurality of pixel blocks of a squire shape in the number 8×8=64, forexample. Here, each pixel of them is formed with the data of apredetermined number of bits, for instance, if it is formed with thedata of 8 bits, it is for a resolution power of 256 steps. And, such thedata of the number of sixty-four (64) gathering together construct eachof the pixel blocks.

Here, in case that a certain pixel block is coincident with the pointwhere the additional information data is to be embedded, a process isapplied to the pixel block depending on the values, i.e., 1 or 0 ofrespective bits of the additional information data. For example, whenone of the bits of the additional information data which is to beembedded into that point is “1”, then the values of the data of the 64pixels are converted or altered in such a manner that the total value ofthe 64 pixel data comes to be a multiple of 256:

(a 0+a 1+a 2+ . . . a 63) mod 256=0

(“mod” indicates a residuum of division) on the other hand, when it is“0”, the values of the data a0 through a63 are converted or altered insuch a manner that the total value of the 64 pixel data comes to be amultiple of 256 plus the residuum 128, i.e.:

(a 0+a 1+a 2+ . . . a 63) mod 256=128

Here, according to the present invention, the value of the 256 (and also0, and 128) should not be restricted only to that value, however, if itis selected to be a larger one, though it is easy to make the decisionas well as to reduce the number of errors, while the original data ofthe 64 pixels are changed by large amounts of values thereof.

The values of the 64 pixel data in the one pixel block are converted oraltered in this method, thereby the additional information data areembedded into the video data one by one, separately.

Those additional information data, however, sometimes happen to bereproduced incorrectly, i.e., with error through the transmissionsystem, in particular when they are compressed/decompressed after beingembedded. Therefore, taking such the case into the consideration, thecondition for deciding the value of the each bit of the additionalinformation data after being received should not be restricted only tothat defined in the above, i.e.,

(a 0+a 1+a 2+ . . . a 63) mod 256=0

however, it is preferable to be selected to 0±α (α is an arbitrary valuebeing equal or less than 64 (α≦64) which is determined by thecompression method, etc.).

Here is described the example in which the additional information dataare embedded into the values of the pixel block of the picture of, suchas the video data, however, it is also possible to embed or conceal theadditional information data into a transmission data, such as values ofbit-stream which are obtained through a frequency conversion, such asDCT (discrete cosine transfer) or FFT (fast Fourier transform).

FIG. 4 shows an example of the points or positions, at which theadditional information data are embedded, within one piece of thepicture (an unit of the video data) as a whole. At the plurality ofpoints of number (n+m)×P in the picture data, the additional informationdata are embedded or concealed, separately and repetitively.

When receiving, the P bits of b0 are gathered from the points where theb0 bits are embedded so as to make the decision on the value of the b0bit by the majority rule. This is effected with respect to the n+m bits,thereby obtaining the additional information data after the majorityrule decision. In this manner, by embedding each bit of the additionalinformation data into the plurality of points repetitively, it ispossible to make the majority rule decision when receiving, therebyenabling reproduction of the additional information bits correctly.

FIG. 5 shows an embodiment of a signal processing apparatus ofperforming the process of coding/decoding, for the data transmissionaccording to the present invention. In this embodiment, there is shown acase where the additional information of several ten bits are embeddedor concealed into the video data and are recorded and/or reproducedinto/from a disc, such as the DVD.

Here, a reference numeral 1 indicates an input terminal of theidentification information bits, 2 an error correction code generator, 3a repetitive data generator, 4 an input terminal of the video data, 5 apixel block divider, 6 a pixel data generator, 7 an embedding device ofthe additional information data, 8 a compressor/encoder, a 19 arecord/playback changeover switch, 10 a pick-up, 11 a disc, 12 a spindlemotor, 13 an extender/decoder, 14 an embedded data detector fordetecting the data being embedded into the data, such as the video data,15 a majority rule decision device, 16 an error correction device, 17 asystem controller, 18 a playback output controller, and 19 an outputterminal of the reproduced video data, respectively.

In the same figure, the identification information data which isprovided at the input terminal 1 includes, for example, a copy controlinformation which is necessary for playback. Namely, playback control,i.e., inhibit of playback and/or inhibit of outputting the reproducedsignal, is conducted in accordance with this information. The errorcorrection code generator 2 generates and adds so-called parities to theidentification information data at the input terminal 1 as the errorcorrection codes, and the repetitive data generator 3 makes copies ofthe data being formed by adding the error correction codes to theidentification information, for the number of times (i.e., P times) ofbeing transmitted repetitively. The video data at the input terminal 4is an original data of such as the video data, and are coded with apredetermined format so as to be transferred. The pixel block divider 5divides the original video data into the plurality of pixel blocks beingmade of the 8×8 pixel data so as to be embedded with the additionalinformation data therein. The embedding device 7 performs a process forembedding the additional information data, to which the error correctioncodes are added, into the divided pixel blocks of video data. This isdone by embedding one (1) bit of the additional information data at thepredetermined points or positions one by one, repetitively.

The data formed in this manner are compressed by the compressor/encoder8 and then encoded in accordance with a predetermined recording format.With this, the data being fitted for the recording format are producedand are written by the pickup 10 on a recording layer on the disc 11.

The spindle motor 12 is an electric motor which ratably drives the disc11 therewith.

When performing playback (reproducing), the record/playback change-overswitch 9 is turned to the playback side, and the reproduced data aresent from the pickup 10 which reads out the signals recorded on the disc11 to the extender/decoder 13. With this extender/decoder 13, a decodingprocess in accordance with the coding method is performed on thereproduced data, and then the data are extended. From the data, inparticular, from the pixel blocks in which the additional informationdata are embedded, the additional information data of the number ofrepetition (i.e., P times) are detected with the embedded data detector14. The majority rule decision device 15 makes decisions on the value ofeach bit of additional information data which are detected at the numberof the repetition number (i.e., P times), and the additional informationdata are constructed with the data which are decided by the majorityrule. The error correction device 16 detects the error(s) in theinformation bits of the identification data and corrects it/them, withuse of the correction codes which are contained in the embeddedadditional information data. The information bits which are reproducedin this manner has a low possibility of error. And, if the reproducedinformation bits construct the identification data including the copycontrol, such as the information of inhibiting or protecting from thecopy thereof, then the system controller 17 controls the playback outputcontroller 18 in such a manner that it stops outputting of thereproduced video data at the output terminal 19.

Here, it is assumed that the each additional information data isconstructed with the total 46 bits data, i.e., with the identificationdata of 32 bits, which are provided at the input terminal 1, the errorcorrection code of 6 bits, and 8 bits data indicting a head of the data.If 2,000 points or positions are set as those for embedding theadditional information data therein, within one piece of the pictures,then the additional information data can be transferred by 43 times,repeatedly. Here, if the error rate in the transmission system is 0.1,then the probability that the error can be contained in the informationbits comes to be 1×10E⁻¹⁰ after being conducted with the majority ruledecisions thereon in the playback operation. If the error rate in thetransmission system is 0.2, then it comes to be about 5×10E⁻⁶. With suchthe error rate, in case where the error correction is executed with useof the error correction codes of 6 bits, the error rate comes down to1×10E⁻⁹˜1×10E⁻¹⁰, therefore it is possible to suppress an input errorrate down to low.

FIG. 6 shows an another variation of the flow of processes ofcoding/decoding for the data transfer, according to the presentinvention. Here, the reference numerals same to those in FIG. 1 indicatethe same elements thereof.

In FIG. 6, as in the same manner as shown in FIG. 1, the identificationinformation data of n bits to be transferred are encoded or convertedinto the additional information data of n+m bits by using a conversiontable which is provided for encoding of the identification data inaccordance with a predetermined rule. The same additional informationdata encoded are also transferred repetitively at the plurality of times(P times) for lessening the influence upon occurrence of the change orerror in the additional information data due to the condition of thetransmission system. Here, by transferring the number of repetition P inadvance with use of a separate means, it is possible to set therepetition number corresponding to the condition of the transmissionsystem suitably, even in a case where there are plural kinds oftransmission systems, in which the they are different from one other inthe most suitable number for the repetition. In the case where thetransmission system is the disc, for example, the repetition number isdetermined from the data compression/extension rate in the playbackoperation as well as the error rate of the disc, and the value of it isstored or recorded in a specific portion of the disc, i.e., a TOC (Tableof Contents) area, for example. And, when reproducing, the repetitionnumber is reproduced first of all. With use of such the method, it ispossible to transfer the additional information data with the repetitionnumber being suitable for the transmission system.

For instance, in a case where the data compression, such as MPEG or thelike, is applied to the video data for the transmission thereof, sincethere is provided a header for each unit, i.e., a picture of the screenin the data format of the MPEG, it is possible to insert the repetitionnumber P into a portion of the header as an additional informationthereto. Further, it is also possible to insert the repetition number Pfor each of an unit of GOP (Group of Picture), which is a data unit inthe MPEG format. In those cases, the repetition number P can betransferred by the unit of the picture or the GOP, thereby enabling therepetition which is most suitable for the video data.

Here, if the value of the repetition number P can be deciphered, thereis a possibility that it is changed or altered in the value thereof. Forkeeping a secrecy thereof, it is preferable that the repetition number Pis stored or written in code, thereby making it difficult to bedeciphered, and strengthening an algorithm of it.

Transferring the information data with use of such the method mentionedabove, it is possible to set the repetition number P suitablycorresponding to the condition of the transmission system, even in acase where there are plural kinds of transmission systems in which thethey are different from one other in the most suitable number for therepetition. Thereby, it is possible to execute the majority ruledecision on the additional information data so as to reduce down theerror rate thereof, and to enable the error correction with use of theerror correction codes. Further, with the method being same to this, itis also possible to transfer the information relating to the positionsor points in which the additional information data are embedded and/orthe threshold value (such as the a α=256 mentioned in the above) forexecuting the majority rule decision. Moreover, though the explanationwas given on the majority rule decision which is used for deciding thevalue of each bit of the additional information data from the P numberof embedded data in the embodiments mentioned in the above, however, thepresent invention should not be restricted only to such the rule.Namely, in place of the majority rule decision, a way of decision ofusing a threshold value is also applicable, i.e., if the same value (1or 0) is detected by a plurality of times which is greater than thethreshold value thereof, for each one bit of the additional informationdata, then the detected value is decided to be the value of that bit.

FIG. 7 also shows a further other variation of the flow of processes ofencoding/decoding for the data transfer, according to the presentinvention. Here, the reference numerals same to those in FIG. 1 indicatethe same elements thereof.

In FIG. 7, also in the same manner as shown in FIG. 1, theidentification information data of n bits to be transferred are encodedinto the additional information data of n+m bits by a conversion tablewhich is provided for converting the identification information data inaccordance with a predetermined rule. In this time, it is preferable toencode or alter the data into those which are not easily confused withthe other data. The additional information data encoded are alsotransferred repetitively at a plurality of times (P times) for lesseningthe influence upon occurrence of the change or error in the additionalinformation data due to the condition of the transmission system.Heretofore is the description about the transmitter side. The additionalinformation data are transmitted repeatedly are transferred to thereceiving side. At the receiver side, with respect to the additionalinformation data which are transmitted repeatedly, the decisions aremade by the majority rule by the number of repetitions, i.e., P times.Namely, if the data is the digital data, the value which are detected bytimes more than P/2 is decided to be the value of the data. Thismajority rule decision is made by P times with respect to each bit ofthe data of n+m bits, thereby obtaining the additional information dataof n+m bits. After that, the additional information data is decodedthrough a decoder table which is contrary to that of the encoder usedwhen encoding the data, thereby obtaining the original identificationinformation data of the n bits.

Transferring the information data with use of such the method mentionedabove, it is possible to execute the majority rule decision upon theadditional information data so as to reduce down the error rate thereof,and to enable the error correction with use of the error correctioncodes, even in case where the error rate of the data is high dependingon the transmission system, therefore is impossible the error correctionwith use of the error correction codes.

Further, FIG. 8 shows an another embodiment of the flow of processes ofcoding/decoding for the data transfer, according to the presentinvention.

In FIG. 8, each of the additional information data is also embedded intothe units of the pixel block, in the same manner as is disclosed in FIG.3 above. In this embodiment, it is assumed that the number of the bitsof the identification information data to be transferred is constructedwith K bits (for example, K=6, therefore, 2⁶=64 patterns), and that thenumber of the pixel blocks into which the information bits of theidentification information data are embedded is L within each one pieceof the pictures. In this embodiment, for instance, if the bits of theidentification information data are “00_(—)0000”, the total value (=0)of the bits of the identification information data is embedded intoevery L pieces of the pixel blocks of the one piece of the picture,which are indicated by “” in the figure, and if the bits of theidentification information data are “00_(—)0001”, the total value (=1)of the of the identification information data is embedded into the everyL pieces of the pixel blocks of the one piece of the picture, which areindicated by “▪” in the figure. In this manner, the identificationinformation data are embedded into the each picture, corresponding tothe 64 kinds of patterns in case that it is of six (6) bits data, insuch a manner that the position of the every pixel block neveroverlapped among all of the 64 kinds of patterns of the pictures intowhich the identification information data are embedded. Here, at leastK×L (64×60=3840) pixel blocks are necessary to be contained in one pieceof the picture. This is because, if the number is less than that, theembedding patterns overlap to each other, therefore, the probability ofdetecting the embedded identification information data incorrectly witherror(s) is increased, when deciding the corresponding bits of them.

Embedding the identification information data in this manner, while itis possible to decide if the identification data is embedded or not,upon the presence of data corresponding to the specific embeddedpatterns in the information data of the reproduced data at the receiverside. And, also it is possible to decide the identification informationdata upon a fact that which embedded pattern it is coincide with or nearto. In case that the identification information data are transferred inthis method, there can be happen a case where the embedded position(s)is/are detected at the position(s) other than those of the embeddedpattern mentioned above, however, by searching or checking it over thepatterns at the positions of the number L, since only one pattern comesto be approximated to, thereby it is possible to decide theidentification information uniquely.

Further, as the embedded patterns can be used those which arepredetermined previously, however, it is also possible to code theinformation relating to the embedded pattern corresponding to eachidentification information bit so as to transfer them as data inadvance, thereby using the embedded patterns corresponding to therespective conditions of the transmission systems of the data,appropriately.

FIG. 9 shows an example of a method of deciding the identificationinformation data when receiving them which are embedded in accordancewith the manner shown in FIG. 8. Further, FIG. 10 shows an example ofchanges in the condition of the decisions on the identificationinformation data at that time.

In FIG. 9, first of all, it is decided whether the identificationinformation data are embedded or not, upon the presence of the datawhich is near to one of the patters of the identification informationdata in the received data, and it is decided by a fact which one of theembedded patterns it is coincide with. Here, when embedding theidentification information data, the value to be altered or converted isdetermined within a certain range of a value, for example, when thetotal value of the values of the pixel data of the pattern of theidentification information bit is changed within a range 512±64 (forinstance, in case of data of 9 bits), the embedding of the data can bedetected at a probability of one fourth (¼) of a value in a case wherethe identification information data are embedded, even when noidentification information data are embedded. Therefore, which one ofthe embedded patterns the data comes to be coincident with can bedecided, though they are not completely coincident with due to theerror(s) of the transmission system, by selecting one among of them, inparticular, which shows more points coincident with those of the patternthan the others.

Here, assuming that one piece of the picture is to be the data of oneframe, the data of the embedded pattern corresponding to theidentification information bits are converted into the data of the oneframe to be transferred. At this time, if the probability of the errordetection in the identification information bits is high as the resultof transmission thereof, it is possible to increase up the reliabilityby detecting and deciding the identification information bits in asequence. For example, it is conditioned that the identificationinformation bits can be detected by detecting them for 4 frames insequence, continuously, and that the detection is started again if aframe which does not coincide with is detected on the way of detectiontherefore the identification information bits cannot be detected for 4frames continuously. And as the result of this, when the sameidentification bits are detected continuously, the identification bitscan be decided.

Reference marks {circle around (1)} through {circle around (6)} in FIG.10 correspond to branches of the flow shown in FIG. 9. When detectingthe frames in which the identification information data are embedded, itcomes to the branch {circle around (2)}, while it comes to the branch{circle around (3)} when no such the frame in which the identificationinformation data are embedded can be detected. And, when four (4) ofsuch the frames can be detected continuously, it comes to the branch{circle around (4)}, while it comes to the branch {circle around (3)}when no such the continuous frames cannot be found, thereby determiningthe information bits thereof.

Next, in FIG. 9, after determining the identification information bitsonce, they will not be invalidated soon, even if occurring such theframe that it is not coincide with the embedding pattern therefore theidentification information bits cannot be determined therefrom. Forinstance, the identification information bits being determined once arecanceled only when the same identification information bits can bedetected continuously for the four (4) frames in sequence, therebytrying the determination again. In this way, by protecting theidentification information bits being determined once, it is possible tomaintain them dealing with omission of data due to deterioration of theerror rate in the transmission system.

In FIG. 10, when no frames cannot be found continuously four (4) times,the flow comes to the branch {circle around (6)}, however, if not so, itcomes to the branch {circle around (5)} so as to maintain theidentification information bits as before.

With use of such the method, it is possible to prevent from theerroneous detection of the identification information bits, and also toobtain the protection of them after the detection thereof.

As is fully described in the above, according to the present invention,when transmitting the video and/or audio data added with the additionalinformation bits of such as the copy protection, the error correctioncodes are added to the additional information bits so as to correct themif error occurs therein, thereby preparing the additional informationdata to be transmitted. And, for lessening the influence upon theadditional information data due to the change or error of the data inthe transmission system, the same additional information data areembedded into the original video data repetitively, by plural times(i.e., P times).

When receiving, with respect to the additional information data whichare embedded repetitively, the determination by the majority rule isexecuted thereon. Assuming that the additional information data arerepeated by P times, a value of the majority (more than P/2) among thereceived data of number P is decided to be the value. The determinationby the majority rule is executed by gathering the data of the number Pfor all of the bits, thereby obtaining the additional information data.After that, the errors of the additional information bits are detectedand/or corrected by use of the error correction codes, thereby obtainingthe identification information bits contained therein, correctly.

By transmitting the information data with use of such the method, theerror rate of the additional information data can be reduced through thedetermination by the majority rule, and correction of error can beperformed by use of the error correction codes, even in the case wherethe error correction cannot be executed because of high error rate ofthe data due to the transmission system, thereby achieving thetransmission of such the additional information data with highreliability.

Further, by determining the embedding patterns corresponding theadditional information bits and embedding them with converting orchanging the data values of the pixel blocks thereof, while determiningthe additional information bits on the basis of continuous detection ofthe embedding patters when receiving, and resetting the additionalinformation bits (i.e., deciding that no additional information bits areembedded) when occurring such the condition that no embedded patterncannot detected continuously, after once making the determinationthereof, thereby the determination and the protection of the additionalinformation bits can be achieved.

What is claimed is:
 1. A data transmission method for information datacontaining addition information data therewith, comprising, at atransmitter side, the following steps: a first step for adding errorcorrection codes for correcting error to said additional informationdata; a second step for embedding said additional information data addedwith said error correction codes into the information data by pluraltimes, repetitively; and a third step for transmitting the informationdata embedded with the repetitive additional information data therein.2. A data transmission method for the information data transmittedthrough the method as claimed in claim 1, comprising, at a receiverside, the following steps: a fourth step for receiving the transmittedinformation data embedded with the repetitive additional informationdata therein; a fifth step for detecting the repetitive additionalinformation data embedded from said transmitted information datareceived in the fourth step; a sixth step for determining saidadditional information data based on a majority rule when receiving saidinformation data; and a seventh step for correcting error with using theerror correction codes received and determined when said additionalinformation data contains error(s) therein.
 3. A data transmissionmethod as claimed in claim 1 or 2, wherein said information dataincludes at least one of video data, audio data and text data.
 4. A datatransmission method for information data containing additionalinformation data therewith, comprising, at a transmitter side, thefollowing steps: a first step for encoding said additional informationdata in accordance with a predetermined conversion table; a second stepfor embedding said additional information data encoded in the above stepinto the information data by plural times, repetitively; and a thirdstep for transmitting the information data embedded with the repetitiveadditional encoded data therein.
 5. A data transmission method for theinformation data transmitted through the method as claimed in claim 4,comprising, at a receiver side, the following steps: a fourth step forreceiving the transmitted information data embedded with the repetitiveadditional information data encoded; a fifth step for detecting therepetitive additional information data encoded, which are embeddedwithin the information data received; a sixth step for determining saidencoded additional information data on a basis of a majority rule of therepetitive encoded additional information data detected; and a seventhstep for decoding the encoded data into the additional information data.6. A data transmission method as claimed in claim 4 or 5, wherein saidinformation data includes at least one of video data, audio data andtext data.
 7. A data transmitting apparatus for transmitting informationdata containing additional information data therewith, comprising: afirst means for adding error correction codes for correcting error tosaid additional information data; a second means for embedding theadditional information data added with the error correction codes bysaid first means into the information data by plural times,repetitively; and a third means for transmitting the information dataembedded with the repetitive additional information data therein.
 8. Adata transmitting apparatus as claimed in claim 7, wherein said thirdmeans includes means for recording the information data embedded withthe repetitive additional information data onto an optical informationrecording medium.
 9. A data reproducing apparatus for reproducing thetransmitted information data transmitted by the data transmittingapparatus defined in claim 7, comprising: a first means for receivingthe transmitted information data embedded with the repetitive additionalinformation data therein; a second means for detecting the additionalinformation data embedded from the transmitted information data receivedby said first means; a third means for determining said additionalinformation data on a basis of a majority rule when receiving saidinformation data; and a fourth means for correcting error with using theerror correction codes received and determined when said additionalinformation data contains error(s) therein.
 10. A data transmittingapparatus for transmitting information data containing additionalinformation data therewith, comprising: a first means for encoding saidadditional information data in accordance with a predeterminedconversion table; a second means for embedding said additionalinformation data encoded in the first means into the information data byplural times, repetitively; and a third means for transmitting theinformation data embedded with the repetitive additional encoded datatherein.
 11. A data transmitting apparatus as claimed in claim 10,wherein said third means includes means for recording the informationdata embedded with the repetitive additional information data onto anoptical information recording medium.
 12. A data reproducing apparatusfor reproducing the transmitted information data transmitted by the datatransmitting apparatus defined in claim 10, comprising: a first meansfor receiving the transmitted information data embedded with therepetitive additional information data encoded; a second means fordetecting the repetitive additional information data encoded which areembedded within the information data received; a third means fordetermining said encoded additional information data on a basis of amajority rule of the repetitive encoded additional information datadetected; and a fourth means for decoding the encoded data into theadditional information data.
 13. An information recording medium forrecording data therein, comprising: information data being reproducible;additional information data which are embedded into said informationdata repetitively; and error correction codes which are added to saidadditional information data and also embedded into said information datarepetitively.
 14. An information recording medium as claimed in claim13, wherein an information, relating to a repetition number of theadditional information data embedded into said information data, isrecorded into a part of said information recording medium.